Pandas Profiling Report

Dataset statistics

Number of variables	10
Number of observations	43152
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	92
Duplicate rows (%)	0.2%
Total size in memory	3.1 MiB
Average record size in memory	76.0 B

Variable types

Numeric	9
Categorical	1

Alerts

Dataset has 92 (0.2%) duplicate rows	Duplicates
`carat` is highly overall correlated with `price` and 3 other fields	High correlation
`price` is highly overall correlated with `carat` and 3 other fields	High correlation
`x` is highly overall correlated with `carat` and 3 other fields	High correlation
`y` is highly overall correlated with `carat` and 3 other fields	High correlation
`z` is highly overall correlated with `carat` and 3 other fields	High correlation
`color` has 5413 (12.5%) zeros	Zeros
`clarity` has 585 (1.4%) zeros	Zeros

Reproduction

Analysis started	2023-12-03 10:10:58.023040
Analysis finished	2023-12-03 10:11:10.074831
Duration	12.05 seconds
Software version	ydata-profiling vv4.6.2
Download configuration	config.json

carat
Real number (ℝ)

HIGH CORRELATION

Distinct	268
Distinct (%)	0.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.79823322

Minimum	0.2
Maximum	5.01
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	674.2 KiB

Quantile statistics

Minimum	0.2
5-th percentile	0.3
Q1	0.4
median	0.7
Q3	1.04
95-th percentile	1.7
Maximum	5.01
Range	4.81
Interquartile range (IQR)	0.64

Descriptive statistics

Standard deviation	0.47334152
Coefficient of variation (CV)	0.59298649
Kurtosis	1.2331988
Mean	0.79823322
Median Absolute Deviation (MAD)	0.32
Skewness	1.1130548
Sum	34445.36
Variance	0.22405219
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.3	2039	4.7%
1.01	1792	4.2%
0.31	1783	4.1%
0.7	1606	3.7%
0.32	1487	3.4%
1	1213	2.8%
0.9	1189	2.8%
0.41	1098	2.5%
0.71	1044	2.4%
0.4	1044	2.4%
Other values (258)	28857	66.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.2	10	< 0.1%
0.21	8	< 0.1%
0.22	5	< 0.1%
0.23	226	0.5%
0.24	200	0.5%
0.25	159	0.4%
0.26	200	0.5%
0.27	195	0.5%
0.28	158	0.4%
0.29	99	0.2%

Value	Count	Frequency (%)
5.01	1	< 0.1%
4.5	1	< 0.1%
4.13	1	< 0.1%
3.67	1	< 0.1%
3.65	1	< 0.1%
3.4	1	< 0.1%
3.24	1	< 0.1%
3.22	1	< 0.1%
3.11	1	< 0.1%
3.05	1	< 0.1%

color
Real number (ℝ)

ZEROS

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2.5910734

Minimum	0
Maximum	6
Zeros	5413
Zeros (%)	12.5%
Negative	0
Negative (%)	0.0%
Memory size	505.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	3
Q3	4
95-th percentile	6
Maximum	6
Range	6
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	1.6987569
Coefficient of variation (CV)	0.65561899
Kurtosis	-0.86308919
Mean	2.5910734
Median Absolute Deviation (MAD)	1
Skewness	0.19045573
Sum	111810
Variance	2.8857751
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=7)

Value	Count	Frequency (%)
3	9015	20.9%
1	7863	18.2%
2	7644	17.7%
4	6707	15.5%
0	5413	12.5%
5	4274	9.9%
6	2236	5.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	5413	12.5%
1	7863	18.2%
2	7644	17.7%
3	9015	20.9%
4	6707	15.5%
5	4274	9.9%
6	2236	5.2%

Value	Count	Frequency (%)
6	2236	5.2%
5	4274	9.9%
4	6707	15.5%
3	9015	20.9%
2	7644	17.7%
1	7863	18.2%
0	5413	12.5%

clarity
Real number (ℝ)

ZEROS

Distinct	8
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.8340054

Minimum	0
Maximum	7
Zeros	585
Zeros (%)	1.4%
Negative	0
Negative (%)	0.0%
Memory size	505.7 KiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	2
median	4
Q3	5
95-th percentile	7
Maximum	7
Range	7
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	1.7249381
Coefficient of variation (CV)	0.44990498
Kurtosis	-0.82615679
Mean	3.8340054
Median Absolute Deviation (MAD)	1
Skewness	0.17678979
Sum	165445
Variance	2.9754115
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=8)

Value	Count	Frequency (%)
2	10520	24.4%
5	9793	22.7%
3	7306	16.9%
4	6530	15.1%
7	4044	9.4%
6	2944	6.8%
1	1430	3.3%
0	585	1.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	585	1.4%
1	1430	3.3%
2	10520	24.4%
3	7306	16.9%
4	6530	15.1%
5	9793	22.7%
6	2944	6.8%
7	4044	9.4%

Value	Count	Frequency (%)
7	4044	9.4%
6	2944	6.8%
5	9793	22.7%
4	6530	15.1%
3	7306	16.9%
2	10520	24.4%
1	1430	3.3%
0	585	1.4%

depth
Real number (ℝ)

Distinct	177
Distinct (%)	0.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	61.743046

Minimum	43
Maximum	79
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	674.2 KiB

Quantile statistics

Minimum	43
5-th percentile	59.3
Q1	61
median	61.8
Q3	62.5
95-th percentile	63.8
Maximum	79
Range	36
Interquartile range (IQR)	1.5

Descriptive statistics

Standard deviation	1.4282431
Coefficient of variation (CV)	0.023132048
Kurtosis	5.280629
Mean	61.743046
Median Absolute Deviation (MAD)	0.7
Skewness	-0.087590167
Sum	2664335.9
Variance	2.0398784
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
62	1787	4.1%
61.9	1739	4.0%
61.8	1670	3.9%
62.2	1648	3.8%
62.1	1613	3.7%
61.6	1549	3.6%
61.7	1536	3.6%
62.3	1518	3.5%
62.4	1411	3.3%
61.5	1355	3.1%
Other values (167)	27326	63.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
43	1	< 0.1%
44	1	< 0.1%
51	1	< 0.1%
52.2	1	< 0.1%
52.3	1	< 0.1%
52.7	1	< 0.1%
53	1	< 0.1%
53.1	1	< 0.1%
53.2	2	< 0.1%
53.4	1	< 0.1%

Value	Count	Frequency (%)
79	1	< 0.1%
78.2	1	< 0.1%
73.6	1	< 0.1%
72.9	1	< 0.1%
72.2	1	< 0.1%
71.8	1	< 0.1%
71.6	1	< 0.1%
71.3	1	< 0.1%
70.8	2	< 0.1%
70.6	2	< 0.1%

table
Real number (ℝ)

Distinct	125
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	57.459548

Minimum	43
Maximum	95
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	674.2 KiB

Quantile statistics

Minimum	43
5-th percentile	54
Q1	56
median	57
Q3	59
95-th percentile	61
Maximum	95
Range	52
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	2.2293248
Coefficient of variation (CV)	0.038798162
Kurtosis	3.1564265
Mean	57.459548
Median Absolute Deviation (MAD)	1
Skewness	0.80595361
Sum	2479494.4
Variance	4.9698891
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
56	7942	18.4%
57	7771	18.0%
58	6647	15.4%
59	5298	12.3%
55	4979	11.5%
60	3452	8.0%
54	2061	4.8%
61	1812	4.2%
62	1000	2.3%
63	472	1.1%
Other values (115)	1718	4.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
43	1	< 0.1%
44	1	< 0.1%
49	1	< 0.1%
50	2	< 0.1%
50.1	1	< 0.1%
51	8	< 0.1%
51.6	1	< 0.1%
52	40	0.1%
52.8	2	< 0.1%
53	442	1.0%

Value	Count	Frequency (%)
95	1	< 0.1%
79	1	< 0.1%
76	1	< 0.1%
73	2	< 0.1%
71	1	< 0.1%
70	5	< 0.1%
69	7	< 0.1%
68	18	< 0.1%
67	32	0.1%
66	71	0.2%

price
Real number (ℝ)

HIGH CORRELATION

Distinct	10694
Distinct (%)	24.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3939.4907

Minimum	326
Maximum	18818
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	674.2 KiB

Quantile statistics

Minimum	326
5-th percentile	544
Q1	956
median	2401
Q3	5354.25
95-th percentile	13105.35
Maximum	18818
Range	18492
Interquartile range (IQR)	4398.25

Descriptive statistics

Standard deviation	3990.001
Coefficient of variation (CV)	1.0128215
Kurtosis	2.1498373
Mean	3939.4907
Median Absolute Deviation (MAD)	1671
Skewness	1.6112291
Sum	1.699969 × 10⁸
Variance	15920108
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
605	109	0.3%
698	101	0.2%
789	101	0.2%
625	99	0.2%
828	99	0.2%
544	98	0.2%
776	92	0.2%
802	92	0.2%
552	92	0.2%
720	92	0.2%
Other values (10684)	42177	97.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
326	2	< 0.1%
327	1	< 0.1%
334	1	< 0.1%
336	1	< 0.1%
337	1	< 0.1%
338	1	< 0.1%
339	1	< 0.1%
340	1	< 0.1%
342	1	< 0.1%
344	1	< 0.1%

Value	Count	Frequency (%)
18818	1	< 0.1%
18806	1	< 0.1%
18804	1	< 0.1%
18797	1	< 0.1%
18795	2	< 0.1%
18791	1	< 0.1%
18788	1	< 0.1%
18787	1	< 0.1%
18781	1	< 0.1%
18780	1	< 0.1%

x
Real number (ℝ)

HIGH CORRELATION

Distinct	544
Distinct (%)	1.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5.7326071

Minimum	0
Maximum	10.74
Zeros	7
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	674.2 KiB

Quantile statistics

Minimum	0
5-th percentile	4.29
Q1	4.72
median	5.7
Q3	6.54
95-th percentile	7.65
Maximum	10.74
Range	10.74
Interquartile range (IQR)	1.82

Descriptive statistics

Standard deviation	1.1201963
Coefficient of variation (CV)	0.19540783
Kurtosis	-0.61092113
Mean	5.7326071
Median Absolute Deviation (MAD)	0.92
Skewness	0.37530417
Sum	247373.46
Variance	1.2548397
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
4.38	359	0.8%
4.37	350	0.8%
4.34	339	0.8%
4.39	324	0.8%
4.33	324	0.8%
4.32	320	0.7%
4.35	313	0.7%
4.31	312	0.7%
4.41	308	0.7%
4.36	301	0.7%
Other values (534)	39902	92.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	7	< 0.1%
3.73	2	< 0.1%
3.74	1	< 0.1%
3.76	1	< 0.1%
3.77	1	< 0.1%
3.79	2	< 0.1%
3.81	3	< 0.1%
3.82	2	< 0.1%
3.83	3	< 0.1%
3.84	3	< 0.1%

Value	Count	Frequency (%)
10.74	1	< 0.1%
10.23	1	< 0.1%
10	1	< 0.1%
9.86	1	< 0.1%
9.54	1	< 0.1%
9.53	1	< 0.1%
9.51	1	< 0.1%
9.49	1	< 0.1%
9.44	3	< 0.1%
9.42	2	< 0.1%

y
Real number (ℝ)

HIGH CORRELATION

Distinct	543
Distinct (%)	1.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5.736434

Minimum	0
Maximum	58.9
Zeros	6
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	674.2 KiB

Quantile statistics

Minimum	0
5-th percentile	4.3
Q1	4.73
median	5.71
Q3	6.54
95-th percentile	7.64
Maximum	58.9
Range	58.9
Interquartile range (IQR)	1.81

Descriptive statistics

Standard deviation	1.1474997
Coefficient of variation (CV)	0.20003712
Kurtosis	112.0351
Mean	5.736434
Median Absolute Deviation (MAD)	0.92
Skewness	2.9098111
Sum	247538.6
Variance	1.3167556
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
4.34	348	0.8%
4.37	348	0.8%
4.35	331	0.8%
4.38	329	0.8%
4.33	326	0.8%
4.32	323	0.7%
4.39	321	0.7%
4.4	321	0.7%
4.41	308	0.7%
4.36	301	0.7%
Other values (533)	39896	92.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	6	< 0.1%
3.68	1	< 0.1%
3.71	2	< 0.1%
3.72	1	< 0.1%
3.73	1	< 0.1%
3.75	1	< 0.1%
3.77	2	< 0.1%
3.78	5	< 0.1%
3.82	1	< 0.1%
3.83	1	< 0.1%

Value	Count	Frequency (%)
58.9	1	< 0.1%
31.8	1	< 0.1%
10.54	1	< 0.1%
10.16	1	< 0.1%
9.85	1	< 0.1%
9.81	1	< 0.1%
9.48	1	< 0.1%
9.46	1	< 0.1%
9.42	1	< 0.1%
9.4	1	< 0.1%

z
Real number (ℝ)

HIGH CORRELATION

Distinct	366
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.5392559

Minimum	0
Maximum	31.8
Zeros	19
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	674.2 KiB

Quantile statistics

Minimum	0
5-th percentile	2.65
Q1	2.91
median	3.53
Q3	4.04
95-th percentile	4.73
Maximum	31.8
Range	31.8
Interquartile range (IQR)	1.13

Descriptive statistics

Standard deviation	0.70806215
Coefficient of variation (CV)	0.20005961
Kurtosis	58.221996
Mean	3.5392559
Median Absolute Deviation (MAD)	0.57
Skewness	1.7929706
Sum	152725.97
Variance	0.50135201
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2.7	599	1.4%
2.69	596	1.4%
2.71	586	1.4%
2.68	579	1.3%
2.72	575	1.3%
2.67	515	1.2%
2.73	487	1.1%
2.74	438	1.0%
2.66	427	1.0%
4.02	421	1.0%
Other values (356)	37929	87.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	19	< 0.1%
1.07	1	< 0.1%
1.53	1	< 0.1%
2.06	1	< 0.1%
2.24	1	< 0.1%
2.25	1	< 0.1%
2.26	1	< 0.1%
2.27	1	< 0.1%
2.29	1	< 0.1%
2.3	1	< 0.1%

Value	Count	Frequency (%)
31.8	1	< 0.1%
8.06	1	< 0.1%
6.98	1	< 0.1%
6.72	1	< 0.1%
6.43	1	< 0.1%
6.38	1	< 0.1%
6.27	1	< 0.1%
6.13	1	< 0.1%
5.98	1	< 0.1%
5.97	1	< 0.1%

cut
Categorical

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	674.2 KiB

2	17259
3	11016
4	9700
1	3902
0	1275

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	43152
Distinct characters	5
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1
2nd row	4
3rd row	3
4th row	1
5th row	4

Common Values

Value	Count	Frequency (%)
2	17259	40.0%
3	11016	25.5%
4	9700	22.5%
1	3902	9.0%
0	1275	3.0%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
2	17259	40.0%
3	11016	25.5%
4	9700	22.5%
1	3902	9.0%
0	1275	3.0%

Most occurring characters

Value	Count	Frequency (%)
2	17259	40.0%
3	11016	25.5%
4	9700	22.5%
1	3902	9.0%
0	1275	3.0%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	43152	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
2	17259	40.0%
3	11016	25.5%
4	9700	22.5%
1	3902	9.0%
0	1275	3.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	43152	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
2	17259	40.0%
3	11016	25.5%
4	9700	22.5%
1	3902	9.0%
0	1275	3.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	43152	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
2	17259	40.0%
3	11016	25.5%
4	9700	22.5%
1	3902	9.0%
0	1275	3.0%

Auto

Heatmap
Table

	carat	clarity	color	cut	depth	price	table	x	y	z
carat	1.000	-0.215	0.249	0.116	0.033	0.963	0.192	0.996	0.996	0.993
clarity	-0.215	1.000	-0.020	0.143	-0.050	-0.115	-0.084	-0.213	-0.211	-0.216
color	0.249	-0.020	1.000	0.040	0.052	0.150	0.030	0.245	0.245	0.250
cut	0.116	0.143	0.040	1.000	-0.128	0.036	0.289	0.042	0.044	0.020
depth	0.033	-0.050	0.052	-0.128	1.000	0.013	-0.248	-0.021	-0.023	0.106
price	0.963	-0.115	0.150	0.036	0.013	1.000	0.168	0.963	0.963	0.957
table	0.192	-0.084	0.030	0.289	-0.248	0.168	1.000	0.199	0.193	0.157
x	0.996	-0.213	0.245	0.042	-0.021	0.963	0.199	1.000	0.998	0.987
y	0.996	-0.211	0.245	0.044	-0.023	0.963	0.193	0.998	1.000	0.987
z	0.993	-0.216	0.250	0.020	0.106	0.957	0.157	0.987	0.987	1.000

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	carat	color	clarity	depth	table	price	x	y	z	cut
26546	2.01	2	3	58.1	64.0	16231	8.23	8.19	4.77	1
9159	1.01	1	3	60.0	60.0	4540	6.57	6.49	3.92	4
14131	1.10	4	5	62.5	58.0	5729	6.59	6.54	4.10	3
15757	1.50	1	3	61.5	65.0	6300	7.21	7.17	4.42	1
24632	1.52	3	4	62.1	57.0	12968	7.27	7.32	4.53	4
49828	0.56	3	6	59.7	59.0	2167	5.41	5.35	3.21	3
38682	0.30	2	6	61.9	55.0	1041	4.32	4.34	2.68	2
44604	0.53	3	5	61.8	56.0	1607	5.21	5.18	3.21	2
11459	1.15	3	5	62.2	54.0	5008	6.74	6.65	4.17	2
2495	0.51	1	6	61.3	56.0	3197	5.13	5.21	3.17	2

	carat	color	clarity	depth	table	price	x	y	z	cut
47191	0.51	1	4	62.3	56.0	1837	5.14	5.13	3.20	3
21962	1.52	5	4	62.9	59.9	10032	7.27	7.31	4.59	4
37194	0.46	5	4	62.3	56.0	974	4.96	4.93	3.08	2
16850	1.00	1	5	62.7	59.0	6720	6.38	6.31	3.98	3
6265	0.87	0	3	61.4	54.0	4012	6.15	6.20	3.79	2
11284	1.05	5	5	62.4	59.0	4975	6.48	6.51	4.05	4
44732	0.47	0	4	61.0	55.0	1617	5.03	5.01	3.06	2
38158	0.33	2	1	60.3	58.0	1014	4.49	4.46	2.70	4
860	0.90	6	2	62.8	59.0	2871	6.13	6.03	3.82	3
15795	1.14	2	2	60.4	58.0	6320	6.82	6.79	4.11	3

Most frequently occurring

	carat	color	clarity	depth	table	price	x	y	z	cut	# duplicates
56	0.79	3	2	62.3	57.0	2898	5.90	5.85	3.66	2	4
0	0.30	0	2	62.2	58.0	709	4.31	4.28	2.67	3	2
1	0.30	3	1	62.1	55.0	863	4.32	4.35	2.69	2	2
2	0.30	4	2	62.2	57.0	450	4.27	4.28	2.66	2	2
3	0.30	6	4	63.4	57.0	394	4.23	4.26	2.69	1	2
4	0.30	6	4	63.4	57.0	506	4.26	4.23	2.69	4	2
5	0.31	0	2	63.5	56.0	571	4.29	4.31	2.73	1	2
6	0.31	0	2	63.5	56.0	732	4.31	4.29	2.73	4	2
7	0.31	0	5	62.1	54.0	734	4.33	4.37	2.70	2	2
8	0.31	0	5	62.1	54.0	942	4.37	4.33	2.70	2	2

Overview

Variables

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Missing values

Sample

Duplicate rows

Most frequently occurring